Deploy OpenLLM to one A100

导言

Practice is the best teacher in learning.

Excellent Video Resource

We’re still on the lookout for an exceptional blog or overview paper to complement our understanding of this topic. Stay tuned for updates!

Outstanding Blog or Overview Paper

The key words are “rethink”, “perspective”

Step 1 : find a suitable one in Leaderboard

Find the best OpenLLM and can be deployed on one single A100. Ranking. 排行榜

1. Open LLM Leaderboard
2. Multi-task Language Understanding on MMLU
3. 中文 榜一 和刷榜二

Step 2 ：download and get

Step 3 : several tranning ways? LoRa?

我LLM 的训练的目的是培养一个我的代理人。文本其实很少，就我正在写的博客的思考的部分是自己写的。关于LLM的训练的原理有几个问题：

1. 如何让LLM意识到他是代理人，就是它是我。
2. 为什么LLM能理解概念，和产生思维(当然这个问题太复杂了，仅仅从训练的角度出发，当然还有transformer模型的角度。)

https://cloud.tencent.com/developer/article/2331992
https://zhuanlan.zhihu.com/p/646811859

Step 4 : nvsight the tranning bottleneck?

占比最多的元操作是什么？

Step 5 : try traning and inference optimization strategies

参考文献